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Abstract — This paper presents a rotation scale invariant digital 
color image watermarking technique using Scale Invariant 
Feature Transform (SIFT) which is invariant to geometric 
transformation. The image descriptors extracted using SIFT 
transform of original image and watermarked image are used 
for estimating the scaling factor and angle of rotation of 
attacked image. Using estimated factors attacked image is 
then restored to its original size for synchronization purpose. 
As a result of synchronization, watermark detection is done 
correctly. In proposed approach the offline signature, which is 
a biometric characteristics of owner is embedded in second 
level detailed coefficients of discrete wavelet transform of 
cover image. The simulation results show that the algorithm 
is robust against signal processing and geometric attack. 

Index Terms — Biometric watermarking, Bi-Orthogonal 
wavelet , geometric attacks, SIFT 

I. Introduction 

The rapid development of new information technologies 
has improved the ease of access to digital information. It also 
leads to the problem of illegal copying and redistribution of 
digital media. The concept of digital watermarking came up 
while trying to solve the problems related to the management 
of intellectual property of media. Access control or 
authenticity verification has been addressed by digital 
watermarking as well as by biometric authentication [2,3]. 
Recently, biometrics is adaptively merged into watermarking 
technology to enhance the credibility of the conventional 
watermarking technique. By embedding biometrics in the 
host, it formulates a reliable individual identification as 
biometrics possesses exclusive characteristics that can be 
hardly counterfeited. Hence, the conflicts related to the 
intellectual property rights protection can be potentially 
resolved [4] . Biometric watermarking is a special case of digital 
watermarking where the content of watermark or the host 
data (or both) are biometric entities. This imparts an additional 
layer of authentication to the underlying media [3]. 

Though novel and efficient watermarking algorithms 
have been developed, attempts also have been made by 
hackers to remove or destroy embedded watermark through 



various attacks. Among all attacks, especially geometric 
attacks are known as one of the difficult attack to survive. 
This is mainly due to the fact that slight geometric 
manipulation to the marked image desynchronizes the location 
of the watermark and causes incorrect watermark detection 
[4]. Geometric variation of watermarked media can induce 
synchronization errors between the extracted watermark and 
the original watermark during the detection process. It is very 
difficult to cope with geometric distortions especially for 
robust watermarking systems since these attacks break the 
synchronization between the watermark and detector. 
Several approaches have been developed for synchronizing 
schemes, which can be divided into following categories. 

• Use periodic sequence to embed the watermark in a repetitive 
pattern, allowing the detector to estimate the performed attack 
due to altered periodicities. 

• Use of invariant-transform to maintain synchronization 
under rotation, scaling, and translation is the second 
approach. Examples of these transforms are log-polar 
mapping of DFT [8,9] and fractal transform coefficients [10], 
Fourier-Mellin transform, radon transform, Mexican Hat 
wavelet transform etc. Though these schemes are 
theoretically effective but difficult to implement due to poor 
interpolation accuracy during log-polar and inverse log-polar 
mapping. 

• Template based approach to embed reference template to 
assist watermark synchronization during the detection 
process [11]. The template should be invisible and have low 
interference with the previously embedded watermarks. 

• Moments based watermarking schemes makes use of 
magnitudes of Zernike moments as they are rotation invariant. 
Magnitudes of moments can be used as a watermark signal 
or be further modified to carry embedded data [3,14]. 

• Content based scheme is another solution for watermark 
synchronization. Media contents represent an invariant 
reference for geometric distortions so that referring to content 
can solve the problem of watermark synchronization, i.e., the 
location of the watermark is not related to image coordinates, 
but to image semantics [6]. In this approach feature points 
are used as a content descriptor. The extracted feature of 
image content can be used for both watermark embedding 
and detection. 
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Among all synchronization scheme, most promising class of 
synchronization method is feature based approach. In the 
proposed method Shift Invariant Feature Transform (SIFT) 
is used for synchronization purpose. SIFT is used to extract 
the feature points by considering local image properties and 
it is invariant to rotation, scaling, translation and partial 
illumination changes [12]. Feature points, which are also called 
as keypoints are localized elements of a cover image that are 
inherently linked to that image and usually contain semantic 
information. They have the property of being reasonably 
stable and are more difficult to remove by a malicious attacker. 
In this paper we propose a watermarking scheme which is 
resistant to geometric and signal processing attacks for color 
image. Feature points of original image and watermarked image 
are used for synchronization purpose at the time of watermark 
detection. These feature points are calculated by applying 
SIFT. Geometric manipulation is estimated by matching basic 
feature points of original image with attacked image. Offline 
hand written signature of owner is embedded as a watermark 
in second level detailed coefficients of discrete wavelet 
transform of cover object. The cover image is decomposed 
using biorthogonal wavelet transform. The rationale behind 
using handwritten signature as a watermark is that it is a 
socially accepted trait for authentication purpose and closely 
related with copyright holder. The paper is organized as 
follows: A brief review of SIFT is provided in section II. 
Section III provides the outline of the method employed and 
the results are provided in the next section. The last section 
summarizes the work and future scope. 

II. SIFT 

Feature points are elements of information inherently 
linked to the content. These local invariant features are highly 
distinctive and matched with a high probability against large 
image distortions. As a result, the relative position of such a 
feature point remains constant after an attack and hence it is 
suitable for synchronization. 

Though numerous techniques can be applied for feature 
extraction, SIFT proposed by David Lowe [12] has proved to 
be very efficient. Even when the image is subjected to attacks 
like image zoom, rotate, brightness change and affine 
transform, the local features based on SIFT will not be 
changed. Considering the local image characteristics, SIFT 
operator extracts features and their properties such as the 
location (x,y), scale S, and orientation e. The basic idea of the 
SIFT is to extract features through a staged filtering that 
identifies stable points in the scale space by selecting 
candidates for features by searching for peaks in the scale 
space. In order to extract candidate locations for features, 
the scale space D (jc, y, a) is computed using Difference of 
Gaussian (DoG) function as given by equation (1). 

D(x, y, a) = {G (x, y, ka) — G(x, y, cr» * f [x, y) (!) 



Gaussian kernel successively smooths original images with 
a variable-scale tr and calculate the scale-space images by 
subtracting two successive smoothed images. The parameter 
is a variance, called a scale of the Gaussian function. In these 
scale space images, all local maxima and minima are retrieved 
by checking the closest eight neighbors in the same scale 
and nine neighbors in the scales above and below. These 
extrema determine the location (x,y) and the scale 'S' of the 
SIFT features, which are invariant to the scale and orientation 
change of images. 

III. Proposed scheme 

The proposed watermarking method embeds offline 
handwritten signature of the owner which is a biometric 
characteristic as a watermark in color image. The color image 
is separated into three channels red, blue and green. Red 
channel is used to extract feature points using SIFT and these 
feature points are saved as synchronous registration 
information which is required for watermark detection. As 
human eye is less sensitive to changes in blue color, we 
prefer to embed watermark in blue channel. Feature point 
extraction channel and watermark embedding channel are 
separated intentionally to achieve stable feature. The original 
image is not required for watermark detection but feature 
points are used to estimate geometric distortion. Thus, it is a 
semiblind algorithm. An offline hand written signature from 
the user is pre-processed and converted into a binary bit 
string before embedding. 

The proposed scheme is carried out in four phases, 
watermark preparation, watermark embedding phase, the 
geometric attack estimation phase, and watermark detection 
phase. Fig.l shows the block diagram of proposed 
watermarking scheme. 

A. Watermark preparation 

The offline handwritten signature of the owner which is 
used for authentication purpose is converted to a 1 -D binary 
string through vector division with values ranging between 
and 1 only. This is essential as watermarking will be done 
based on these two values only. 

B. Watermark embedding 

Watermark embedding consists of following steps: 

1 . Separate the colour carrier image into three colour channels. 

2. Calculate feature points of red channel by using SIFT and 
save as synchronous registration information. 

3. Perform 2-level DWT using bi-orthogonal wavelet transform 
on the blue and green components of carrier image. 

4. Using a private key generate the pseudorandom sequence 
which is equal to the length of watermark. 

5. Select the LH subband of blue and green channel of 
decomposed image and generate the perceptual mask that 
selects the wavelet coefficients from these bands. This is 
based on pseudorandom sequence using private key. 

6. Embed the watermark in selected coefficients of blue 
component of the host image as based on following logic. 
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Figure 1. Watermark embedding and extraction scheme 



i) For entire length of watermark 

ii) Compare blue channel coefficientswith green channel 
coefficients 

iii) If Watermark bit is ' 1' 

iv) Set blue channel coefficient to a value higher than 
corresponding green channel coefficient 

v) Else if watermark bit is '0' 

vi) Set blue channel coefficient to a value smaller than 
corresponding green channel coefficient 

vii) End if 

viii) End for 

7. Reconstruct the watermarked image using inverse discrete 
wavelet transform 

The offset value (OV) that is to be added or subtracted 
from green channel coefficients to make corresponding blue 
channel coefficients smaller or larger based on watermarking 
bits is given by 

Qy _ AvgJu-m(I b y^mxn 

4 1 J 

Where Avg_lum is the intensity of blue component of image, 

m and n are the dimensions of image. Traditionally, offset 

value is fixed. In proposed scheme the offset is adapted 

depending upon the image. This results in better PSNR than 

fixed offset value. 

C. Geometric attack estimation 

Feature points can be used either for watermark 
embedding/detection or for synchronization. Our approach 
uses SIFT feature points for synchronization.lt can estimate 
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the geometric distortion by using feature points of both 
original and watermarked image. For estimation of geometric 
transform, we have considered the approach of [1]. 

A. SCALE ESTIMATION AND CORRECTION 

Feature points are suitable for watermarking with implicit 
synchronization as those have covariance with geometric 
transformations. 

S = i=iqi (3) 

Where 'm ' is the total number of matched feature points of 
original image and watermarked image, 'S' is the scaling factor 
of attacked watermark image, f% and q,- are the scales of 
matched feature points of original and watermarked image. 
Scaling correction is done by resizing the attacked 
watermarked image by scale correction factor given by 
equation (4). 

scale _correction = S est ~ 1 (4) 

b. Rotation estimation correction 

Angle of rotation of attacked image can be calculated 
based on orientation difference of matched feature points of 
original and attacked image. Assuming watermarked image is 
rotated by an angle 'e', total number of matched feature points 
as 'm', the centre angle of original image feature points as C 
and that of corresponding matched feature point of rotated 
image as r ,the estimation of angle by which watermarked 
image is rotated can be computed as follow: 
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The image is restored to its original shape by rotating it by 
anti rotation factor given by equation (6) 

anti_rotation = —d est (6) 

D. Watermark detection. 

In this stage, watermarked image is checked for any 
geometric distortions such as scaling, rotation or a 
combination of both. Watermark detection steps are as follow: 

1. Segregate the three channels of watermarked colour image 
and extract the feature points of red channel using SIFT. 

2. Synchronization step: 

Compare these feature points with feature points of original 
image to estimation geometric distortion. 

3. Correct these geometric distortions. 

4. Apply 2 level wavelet transform using bi-orthogonal wavelet 
on blue and green channel 

5. Using the private key, generate pseudorandom sequence 
equal to length of watermark which is used as perceptual 
mask. 

6. Using perceptual mask identify the coefficients of blue 
and green channel from LH band of second level 
decomposition. 

7. Watermark detection is based on following logic: 

i) While length of watermark 

ii) Compare blue channel coefficients with corresponding 
green channel coefficients 

iii) If blue channel coefficient is higher than corresponding 
green channel coefficient 

iv) Set watermark bit equal to one 

v) Else if blue channel coefficient is smaller than 
corresponding green channel coefficient 

vi) Set watermark bit equal to zero 

vii) End if 

viii) End while 

8. Reshape it to form two dimensional signature image 

e. Experimentation and results 

The evaluation of proposed scheme is performed by 
keeping in mind that the embedded watermark should be 
invisible and fidelity of host image is maintained. Watermark 
data size is variable depending upon the size of the signature 
image, however the general range is in between 60 x 30 to 120 
x 120. 

Apart from the perceptual quality of the watermarked 
image and recovered watermark, the quantitative metrics used 
to evaluate the quality of watermarked image are PSNR and 
SNR, while that of recovered signature is Structural Similarity 
Index Measure (SSEV1) [13]. 



TAB LEI. PERCENTAGE OF ACCURACY OF ESTIMATED 
SCALE FACTOR 



Scaling factor 


Estimated scaling 
factor 


Percentage of 
accuracy 


0.5 


0.5601 


S7.96 


0.6 


6526 


91.22 


2 


2.0372 


9S.H 




3.0351 


9S.S2 


4 


4.0750 


9S.12 




5.0S04 


PS. 39 


6 


6.1199 


9S.00 



Standard images used for watermarking are Leena, Baboon, 
Pepper, Cameraman etc, while fourteen different signatures 
are taken as a watermark. Table I shows the actual scaling 
factor, estimated scaling factor and percentage of accuracy. 
Table II shows the angle by which image is rotated, estimated 
rotation angle and percentage of accuracy. 



TABLEII. PERCENTAGE OF ACCURACY OF ESTIMATED 
ROTATION ANGLE 



Rotation angle 


Estimated rotation 
angle 


Percentage of 
accuracy 


10 


9.94132 


99.41 


20 


20.0S90 


99.55 


30 


29.S25S 


99.42 


40 


40.3002 


99.25 


€0 


:-9.3999 


99 


90 


S9. 97069 


9957 


100 


100.1319 


99.87 


110 


109.910S 


99.92 


120 


119.4345 


99.53 


150 


14S.9016 


99J27 


170 


169.5421 


99.73 


300 


29S.39S3 


99.47 


330 


330.9143 


99.72 



To verify the invisibility of embedded watermark, quality 
of watermarked image, quality of extracted watermark and 
robustness of scheme against various attacks rigorous 
simulation testing is carried out. A sample output of original 
image, watermarked image along with original and recovered 
watermark is shown in Fig. 2. The average PSNR of 
watermarked image without any attack is above 40dB. SSIM 
of extracted signature from watermarked image under different 
signal processing and geometric attack is tabulated in Table 
III. The perceptual quality of extracted signature is marked 
on a scale of three as good, recognizable and poor. 
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TABLE III. SUMMARY OF ATTACKS 



V . 



(a) 



(b) 



Oi gin al : gnalure image Reccwred Signal!! re image ,SSIM =100* 



(c) 



(d) 



Figure 2 Watermarked image along with original and recovered 
watermark 

A sample of watermarked image which is rotated by 120 
degree and extracted watermark is shown in Fig. 3. 




Figure3. Attacked watermarked image and extracted watermark 

Some of the extracted signatures under different attacks are 
shown in Fig. 4 




(a) Brightness 
(c) Scaled twice 

//l*if 

r 1 ' I!-"'' - " ' 

(e) Cropping 40 percent 



(b) Rotation 50 degree 




(d) Salt and Pepper noise 




(f) Row column copying 
Figure4. Extracted watermarks under different attacks 



Type of 
attack 


parameter 


BSIM 


Perceptual quality of 
recovered stEnature 


Rotate 


30* 


99.43*/; 


RecoEnizable 


40* 


99.15*/; 


RecoEnizable 


45° 




RecoEnizable 


50' 


9B.54% 


RecoEnizable 


BO* 


99.5c" 5 <' s 


RecoEnizable 


120 


99.45% 


RecoEnizable 


SialE 


0.5 


99.6B% 


Good 


1 


9939% 


Good 




9939% 


Good 


3 


99.99*/. 


Good 


4 


99.99 J < t 


Good 


Crop 


10 




Good 


m 


77.1*0 


recoEnizable 


dimes s 




99.24% 


Good 


Salt Sc. Pepper 


01 


99.21% 


recoenizable 


0.2 


9E.65?''s 


RecoEnizable 


Row Column 
Copying 


Random 
selection 


100% 


Good 


Row Column 
BlanktriE 


Random 
seleition 


100% 


Good 


Gaussian 
whit? noise 


0.01 


93.35% 


Recomizable 


0.0B 


9B.45% 


RecoEnizable 


JPEG 


Q = 95 


99.43% 


Good 




7 7 .11 1 /□ 


Go od 


Q= E5 


99.37% 


RecoEnizable 


Q=B0 


99.323% 


RecoEnizable 


Histoaram 
equalization 




94.30% 


Poor 



Conclusion and Future scope 

The paper proposes a novel biometric watermarking 
technique using an amalgamation SIFT. The technique is 
highly robust against numerous geometric and signal 
processing attacks like cropping, scaling, rotation, median 
and Weiner filtering, Gaussian and salt and pepper noise, 
histogram equalization and JPEG compression. 

The fidelity of watermarked image is highly maintained as 
PSNR is above 40dB. However, survival against a combination 
of geometric attack like scaling and rotation, shearing and 
scaling is still a challenge. The current study can be extended 
to develop watermarking scheme using RST invariant 
transform like Complex wavelet transform, Zernike moments 
or combination of both which is resilient to complex 
geometric attacks. 
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